Fusing Time-of-Flight Depth and Color for Real-Time Segmentation and Tracking
نویسندگان
چکیده
We present an improved framework for real-time segmentation and tracking by fusing depth and RGB color data. We are able to solve common problems seen in tracking and segmentation of RGB images, such as occlusions, fast motion, and objects of similar color. Our proposed real-time mean shift based algorithm outperforms the current state of the art and is significantly better in difficult scenarios.
منابع مشابه
Adaptive texture and color segmentation for tracking moving objects
Color segmentation is a very popular technique for real-time object tracking. However, even with adaptive color segmentation schemes, under varying environmental conditions in video sequences, the tracking tends to be unreliable. To overcome this problem, many multiple cue fusion techniques have been suggested. One of the cues that complements color nicely, is texture. However, texture segmenta...
متن کامل3D Real-Time Head Tracking Fusing Color Histograms and Stereovision
A system that performs the tracking of a human head in 3D in real time is presented. The head shape is modeled by an ellipse with a trained color histogram of skin and hair samples. The color histogram is dynamically updated based on incoming image data in order to accommodate for varying illumination conditions. On the other hand, the size of the searched ellipse projected on the image is scal...
متن کاملReconstruction of Deformation from Depth and Color Video with Explicit Noise Models
Depth sensors like ToF cameras and structured light devices provide valuable scene information, but do not provide a stable base for optical flow or feature movement calculation because the lack of texture information makes depth image registration very challenging. Approaches associating depth values with optical flow or feature movement from color images try to circumvent this problem, but su...
متن کاملColor Image Segmentation Based on an Iterative Graph Cut Algorithm Using Time-of-Flight Cameras
This work describes an approach to efficient color image segmentation by supporting an iterative segmentation algorithm with depth data collected by time-of-flight cameras. The algorithm uses an energy minimization approach to segment an image, taking account of both color and region information. The minimization itself is performed by formulating an equivalent minimum cut problem on an image g...
متن کاملTofCut: Towards Robust Real-time Foreground Extraction Using a Time-of-Flight Camera
Foreground extraction for live video sequence is a challenging task in vision. Traditional methods often make various assumptions to simplify the problem, which make them less robust in real-world applications. Recently, Time-ofFlight (TOF) cameras provide a convenient way to sense the scene depth at video frame-rate. Compared to the appearance or motion cues, depth information is less sensitiv...
متن کامل